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I REMARKS 
Claimi 1-44 are now pending m the prcacnt application. The Office Action mailed 
January 16, ibol (hereinafter "Office Action'O rcjccfpd all of Clflims 1-44. More specifically, 
the Office Action rejected Qaims 6, 13, 29, and 36 under 35 U.S.C. § 1 12. sccnnd paragraph, as 
being indefinite for failing to particularly point out and distinctly claim thft subject matixx that 
applicants regard as being their invention The Office Action rejected Claims 1-9, 14-20. 23-32, 

and 37-42 A<\pt 3fiTJ.S,C. § 102(b). Although the Office Action stated that the § 102(b) 

i 

rejection is bised on a public usp nr sd.c nf the invention, applicants assume that the Examinei 
mtended the § 102(b) rejection to be based on anticipation in view of U.S. Patent No. 5,696,964 
issued to Cox et al. (hereinafter "Cox"). The Office Action rejected ClaiTas 21-22 and 43-44 
under 35 U.s|c. § 103(a) as being unpatentable over Cox. The Office Action rejected Claims 
10-12 2md 33';3.S under 7i5 U.S.C. § 103(a) as being unpatentable over Cox in view of U.S. Patent 
No. 5,893,095 issued to Jain rt al. (hereinafter "Jain"). Additionally, the Office Action objected 
to the title the uivendon as not bedng descriptive of the invention to which the claims are 
directed. The Office Action suggested amending the title of the invention tn "Visual Thesaurus 
As AppUed Tjo Media Clip Searching." Applicants are amending the title of the invention as the 
Offjcfi Actinn. MJggests, 

Applicants respectfully traverse the rejections of Clahns 1-44 as set fortli in the Office 
Action. AppUcants are amending the Claims!, 13, 1.6, 18, 24, 36. 38, and 40 to more 
particularly pomt out and distinctly claim the subject matter that applickats regard at> being their 
invention. Applicants respectfully submit that, upon entry of this amendment, all pending 
Claims 1-44 ^rc allowable. More specifically, vvith regpect to the indefiniteness rejections of 
Claims 6 and 29, sipplicants resppr.+fiilly submit ifiat the scope of the limitation "artistic style" is 
clear and definite, since one of ordimuy skill in the art would recognize that art is typically 
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described m terms of tlic art's style. With respect to the indefiniteness rejections of ClEiinis 13 

! 

and 36, appHcants h^ve amended Claims 13 and 36 for clarificatioii purposes so that the tenn 
"keyword" dojes not refer to an earlier recitation and therefore does not lack antecedent basis. 
With respect to the anticipation and obviousness rejectiom, jippHcants respectfully submit that 
neither Cox ijior Jain, either alone or in combination, teaches or suggest.'* ihe. ?mhject matter 
recited in the [rejected claims. Prior to discussing in detail why applicants believe that all of the 
claims in this application are allowable, a brief description of applicants' invention and brief 
descriptions 6f the teachings of Cox and Jam arts provided. The follo^ving discussion of the 
disclosed embodiments of applicants' invention and the discas^ion of the diJEFercnces among the 
disclosed embodiments a^id the teachings in the ^plied references arc not provided to define the 
scope or intciiprtttation of any of the claims. Instead, such discussed differences are provided to 

help the United States Peient and Trademark Office (hereinafter "the Office") to better appreciate 

f 
I 

important claim distinctions discussed thnrafter. 

giCTnmBr v of tee Present Invention 

! 

Xhe present invention is directed to a method, system, and computer-readable medium for 
searching a media clip database associated with a multimedia application program. The mcdta 
clip daiabase incbidns information that describes each associated media clip in the media clip 
database. In response to a user selecting a media clip, informadon associated with the selected 
media clip is retrieved from the media clip daiabase. The in-fbimation associated with the 
selected meia clip is presented and exposed to the user. The user can select search criteria 
based on tU information associated with the selected media clip. In response to the user 
selecting search criteria basftd on. tbe information associated with the selected media clip, all of 
the media clips in the media clip database that have associated information that matches the 
selected search criteria for the selected media clip aic retrieved. 
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In ^c^tdBRce with further aspects of this invention, the search criteria includeg a list of 
keywords, which are oharactaristic words or attritiiites that are storrd iji; the media dip database 
fer use in scdiching the media clip database. In another aspect of this invEntiQii, onr of the 
keywords dcsj^cs the format of the clip, such as "mpeg," or "gif/' In a fteher aspect of this 
invention, aU pf the ke^nnk associated with the clip are displayed in a Find Similar Clips user 
interfece. In y&t mnthp^r aspect of -rtu!^ invention, similar clips are located based on the keywords 
associated with the selected clip; that is, any clip in the clip catalogue having an associated 
keyword that matches at least one of the keywords of the selected clip is lor^tPid. 

In flc<i)rdance with other aspects of this invention, the search criteria includes artistic 

style. If thel vser drcts to locate similar clips based on artistic Style, the clip caialogne is 

! 

searched and! a thimibnail sample of wtr.h of the clips in the clip catalogue having the same 
i 

artistic style as the selected clip is displayed. Preferably, clips of all categories are displayed, 

I 

with the category or categories of the selected clip being displayed first In further aspRcts of this 
invention, "aJtistic style" is an optional keyword aaaociated with a clip. Preferably, a user may 
not add to or hiodify the artistic style of a clip. i,c,. the optional artistio style keyword associated 
with a dip is static. 

In acc»ntoce with a still further aspect of this invention^ clips similar to the selected clip 
are located ijased <m the color and/or shape of the selected clip. In further aspects of this 

invention, keywords define the color and shape of an associated clip. In other aspects of this 

j 

invention, rnathrm?itic?il represcnt^ong define the color and shape of an associated clip. 

i 

Preferably, if the user chooses to locate clips based on color and shape, a thumbnail sample of 
each of the Oltps having a similar color scheme and shape as the selected, clip is displayed. 

In accordance with yet still another aspect of this invention, a user interface that allows a 

user easy accessibility to other fimctions of the multimedia applications program including the 

i 
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I 
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clip caUdoguejis provided. Prcfmbly, the other functions include inserting a cliosen clip into a 
docuDOieiit, plfylng or previewing a chosen clip, and adding a chosen cUp to a category. 
Prcfcitibly, thl user interfece minimizes obscuring of ohjccte displayed on the screen, i.e., clip 

thumhnail skdchca. It is also preferable that any user interface scrftfms accessed (i.e.» additional 

I 

fiinctioas) nl w minimize display obstructioiL 

In accpiHancc with a yet still further aspect of this invention, clips are sorfftH based on 
media type, inferably, ^ rnrdia types include Clip ^ 

the user requests a Clip Art^ctures preview, nn actual-size version of the clip is displayed. If 
I 

the user requjests a Sounds clip pieviev^r, audio is played. If the user requests a Videos clip 
preview, vidcb is played. If the user requests a text clip preview, the full tpxt is displayed. For 
example, if tkc text cKp is a document the document ie displayed, and if the text dip Is an 

annotation (ejg., handwritten note), the annotation is displayed. In accordance with yet a flirdier 

! 

aspect of thi^ invention, clips are also sortEd based on category. Categories include several 
predefined topics. Preferably, a user can add a clip to any desired cstRgory or categories, 

Ap will be readily appreciated from the foregoing summary, the invmtian provides a 
search tool fhr se^srching a clip catalogue containing a plurality of multimedia clips and that 
allows a uset to find a dip that the u.scr will ''know it when I see it." Selecting one or more 
desirable parameters of a selected dip allows a uspr to rapidly locate clips of like type being 
sought so ti^t a final decision can be quickly reached regarding a clip to be used in, for example, 
a doaixnent |hcing prepared. The present invention avoids the need to formulate complex. 

difficult quczkcs. 

I 

Rirmmary of itfae Cox Reference 
I 

The Cox reference is generally directed toward. ?i. inultiuicdia database retrievd system 
that mflintflirja a "posterior probability distribution" that each item m tKc database is a target of a 
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search. Cox idiscloses a queiylcss, multimedia database search method, which incoiporates ^ 
Bayeaian interface engine that refines its anwer vdth each xiser response. The set of user 
responses incliudeQ a series of displays and user actions, and iis defined by a relatively sunple user 
intcHace. The system maintains a posterior probabUity distribution that each image in a 
multimfidia d?ltahasc is the target of the search. This distribution is used to select the next, imagea 
to display to the user and snUcil-^ selections from the user pertaining to images displayed. The 

user's selectidns are then incoiporatpri intn the posterior distribution via a probabilistic user 

I 

modeL [ 

In sudimary. Cox discloses a queryless multimedia database retrieval method and system 
that maintain k posterior probability distribution for use in selecting the next images to display tn 
the user. However, Cox Hoe., not disclose searching a media cUp databa^ that contains 
infonnation describing each associated media clip in the media clip database. Cox also does not 
disclose that; in response to a user selecting a media dip, irvfonnation associated with the 

selected media dip is retrieved from the media clip database. Because Cox docfi not retrieve 

i 

associated information from the database. Cox cannot present the associated information to the 
user, Additkonally, Cox docs not enable the user to select search criteria based on the 
information dssociaied with the selected media clip. Furthermore. Cox does not provide that, m 
response to ib© user selecting search criteria based on the information associated wth the 
selected mejia clip, all of the media clips m the media clip database that associated 

infonnation tHat matches flic selected search criteria fot the selected [media clip are retrieved. 

I 

OnJy the pretoit invention teaches this smhjcct matter. 

i 

Suminarv ofjthe Jain Reference 

I f 

The jain reference is generally directed toward a system and mcfl^od for content-abased 

search and retrieval of visual objects. A base visual information retrieval (VIR) cn£tnc utilizes a 

j 
I 
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set of universal primitives to operate od the vi 
custom, modxllar primitives to be defined and rcj 
apccifio pioblems and can utilize any image-un( 



visnlcd oVjccts, An extensible VIR engine allows 
gistered- A custom priTnitive addresses domain- 
derstanding tedbniquc. Object attn.bules can be 



extracted ovel- the cntiit image or over only a portion of the object. A schema is defined as a 

specific collection of primitives. A specific schen la implies a 3pecific set of visual features to be 

processed an^ a corresponding festnre vectnr to be used for content-based similarity scoring, A 

primitive rej^stration interface registers custom primitives and facilitates storing of an anaJysis 

fimction and ja comparison function in a scheraii table. A hetRmgcncnus comparison allows 

objects analyzed by different schemas to be compared if at least one primitive is in c^ommnn 

between the .jrbptnfts. A ihnwhold-baaed oompaiison is utilized to improve performance of the 

VIR engine, j A distance bctwcCT two feature vectors ii* conaputed in any of the comparison 

processes so as to generate a similariTy score. Ji in also disdoses an alphanijDcnoric query input 

module (hat flfllows the user to specify a target object by alphanumeric attributes. 

In summary, Jain discloses content-based searching and retrieving of vjsnal objects using 
I 

a base m^TiFi hfiving a set of universal primitives and an eKtejisible engine having custom 
primitives. J&in also discloses an alphanmneric query input module for specifying a target uaing 
alphanumeric attributes. However, Jain docs not disclose that, in response to a user selecting a 
media chp, information associated with the selected media clip is retrieved ftom thff media cjip 
database. Bfecauae Jain does not retrieve the associated information; Jain cannot present the 
associated inlFarmrttion l» the user. Additionally, Jain does not enable the User to select search 
criteria based on the retrieved and presEntcd information ;»RRociated writh the selected media clip. 
Only the present invention retrieves and presents descriptive information thflt is associated with a 
selected me<fia clip, which allows the user to select search criteria without having to fomiulatc 



-Page 10 of 26- 



Received from < > at 4/15/02 3:53:3S PM [Eastern Daylight Time] 



r j\W OFFireS OF 
CHRISTENSEN 0'i;i'WKOJ». TfJMNSON lONDNESS"" 
1420 Ftah /VvcmiB 
I Suite 2800 
Seamc. Washington 9BL01 
j 206.6B2.810O 

i 



04/15/02 12:49 FAX 



@014 



complex, difficult queries to retrieve aJl media cUps in the media clip database, that have 
asBOciated infiiirmation that matcbf« the selected search criteria for the selected media clip. 

Rejection of Clainis 6. 13. 29, and 36 Undrx 3 ^ J.^^ ^ 112. Second Paragraph: 

The Office Action rejected Claims 6, 13, 29, and 36 under 35U.S.C. § 112, second 
paragr^h. as feeing indefmite for failing to pardcularly point oirt J*nH distincdy claim the subject 
matter that aplplicants regard as being their invention. With respect to dependent Claims 6 and 
29, the Offici Action states that the phrase "artiatic style" is vague and indefinite. The OfGrp 
Action states [that an artistic ."^tylc is a highly subjective phrase and it j& unclear as to how this 
phrase can b^ quantified. With respect to Claiias 13 and 36, the Office Action states that the 
limitation "the keywords" has insufficient antecedent basis. The OfFlcc Action states that the 
limitation "artistic style" ia being interpreted as a style indicative of color or shape. The Office 

Action also that the Umitatioa "flie keywords" is being interpreted as indicative of clip 

I 
I 

attributes. | 

With jrespect to dependent Claims 6 and 29, applicants respectfully submit that the 
limitation "artistic style" is clear and definite. One of ordinary skill in the art would know that 

art is usually described in terms of the art's style. Fox example, some ardsdc styles include 

i 

portraits, absW htI, cubism art, expressionism* Fauvism, impressionism, pointillism, pop art, 
pos^impress^onism, primitivism, realism, f^uTrealtsm, and art deco. In one embodiment of the 
present invet^on, the artistic style is a keyword and is stoml in the clip database when 1iie clip is 
added to that database, "nxejefore, applicants respectfully submit that the limitation "artistic 
/nylc*' particularly points out and distinctly claims subject matter that applicants regard as being 
thek inventiqn. Thus. appKcants respectfully submit that Claims 6 and 29 are clear and definite 
and allowably. 
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With Aspect to dependent Claims 13 and 36, applicants respectfully submit that, upon 

! ' ' . 

entry of this amcndinftnt, all Ikmtfltions recited in Claims 13 aod 36 will have siifHciftnt 

antecedent bapis. More spccificfilly, Clainjs 13 and 36 have been amended to recite that the 

I 

search criteria includes "a list of keywords" that arc associated with the selected media clip- 
AppUcants al^o reepectfully siihmit that the limitation "keywords" is clear and definite. A 
keyword is a bharacterigtic word or aitribute that is stored in the media cUp database for use in 
seajchiTiE thcimedia clip database. Applicants respectfully eubniit that the tenn "keyword" is 
weD known by those of nrdinary skill in the art at the time the invention was made. Therefore, 
applicants res^jectfuUy submit that Claims 13 and 36 particularly point out and distinctly claim 
subject Daattej that applicants regard as being their invmtinn and that all limitationa recited in 

Claims 13 ank 36 have sufficient antecedent basis. Thus, appUcants rcspcciriully submit that 

I 

Cbitn.s 13 anA 36 are allowable. 

Rejection of Claims 1-9. 14-20. ?^3-32. and 36 ^^ Undgr 35 U.S.C. S 102fbl: 

The Office Action rejected Claims U9. 14-20, 23-32, and 37-42 under 35U.S.C. 
§ 102(b). AjjplicantB assume that the Office Action intended the § 102(b) tx;jftctioji to be under 
grounds of aiiticipation by Cox, and not a public use or sale of the invention as statM in the 
OffTcc ActimL With respect to Claim 1, the 0E5ce Action states that Cox discloses a Pic Hunter 

media searding tool having a GUI irtcrfece tiiat displays four images firom a clip database. 

i 

After the usek selects an image and presses a "GO" button. Cox displays a second set of four 

i 
I 

images similar to the mitially selected image. The Office Action .states that Cox's invention 
analyzes a uster-selected image to retrieve and present a similar set of images. The OfP cr Action 

also states tUat, in choosing an image, the image attributes, such as the color and shape, are 

! 

inherent wittiin said image and arc used as seamb criteria by the system of Cox. Applicants 
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tespectfully dmgxtift with the lejectioa of Claims 1-9, 14^20, 23-32, and 37-42 for the reasons 
discussed belojw. 

Applicants have amended Claim 1 to more particularly point out and distinctly claim the 
subject matterjthat applicants regard as being their mvmttrin. b its present form. Claim 1 recites 
as follows: j 

'L (Amended) A method for searching a media r.lip database 
associated with a multimedia application program^ wherein :said media clip 
datahate contains information that describes each associated media clip in said 
media teKp database, comprising; 

I in response to a user seloctinfl a media clip, retrieving inffFmation 
R^iFi^atcdTviii h said scioctcd media ^UP it^m satd media clip daiaUasB^ 

! presenting said information associated with said selected media clip; and 

i in response to the user selecting a search criteria based on saiH infrirmaticrn 
associked with said selected media clip, retrieving all media dips in said media 
clip database that have associated mfbrmation that matches thp selected search 
cntcnii for the selected media dip. 

enables the user to select a media clip and "retrieve informatinn associated with said selected 

I 

media clip from said media clip database". The method of Claim I pmscnb "said information 
associated wifK said selected media clip" to the user and allows the user to "select se?irch criteria 
based on said information associated with said selected media clip" to retrieve ''all media clips m 
said media (ilip database that have associated, information that matches the selected search 

i 

Catena for tlje selected media clip**. Thus, the method of Claim I allows the user to search a 
media clip database by exposing descriptive information associated with a selected clip, which 
can be utilizsri to select search criteria without having to formulate difficult, complex queries. 

Severbl significant advajitngcs are provided by the method of Clwro 1 . Many users need 
assistance inisearching a media clip database becfiusc they don't Imow what terms to use when 
formulating Queries. This may be due to the user's lack of c:xpcri.cnce in formulating CLuerie$. 
However, evim experienced users are often unsure of which terms to use in formulating queries 

i 
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I 

i 
I 

i 

for a. media clfp because media clip3, such as images, are difficult to describe in word?. TKu5, 
the method of |ci?iiTn 1 provides a novel method of searching a media clip database by selecting a 
media clip aijd retrieving descriptive information . associated with a selected media clip for 
selecting search criteria without having to formulate difRcult, cojnpiex queries, 

Applicpnts respectfully submit that Cox fails to teach or snggpst that, "in response to a 
user selecting la media clip, retrieving injfbnnalion associaied with said selected media rlip from 

said media clip database/' as recited in Claim 1. Cox fails to disclose a media clip database that 

i 

contains mfarjmatinn that describes an associated media clip. Theirefore, Cox cannot teach or 
suggest ''retrieving infbtmation associated with said selected media clip from said media clip 
database". Additionally, Cox is limited to disclosing that, in Tfispnase to the user selecting an 
image, a proliability distribution is recomputed and four images with (he highest pmhahijity 
nmking are displayed. Recomputing the probability distribution as a result of the user selecting a 
media clip is not the same as ''irrtneving a.s50cialed information with said selected clip**. Thus, 
Cox fails to t^ach ox suggest "in response to a iiscr se.lectine a media clip, retrieving information 
associated with said selected media clip from said media clip datjrba.se. Only applicants' 
invention as recited in Claim I provides this subject matter. 

Similarly, applicants respectfully submit that Cox fails to teach or suggest "presenting 
said information associated with sairf selected media clip," as recited in* Claim 1. By presenting 
information sjssociated with the selected media clip, the methnrt of Claim 1 exposes to the user 
descriptive iiibimation associated with a selected clip from which the user nan spIpcI: the Ticarch 

criteria to finji all clips with matching associated information. Cox fails to disclose searching a 

I 

(fetrtbasp! conteinTng information that describes an associsrted media olip. Therefore, Cox cannot 
teach or sugjjest "presentiiiB infomiation aRsociatcd with said selected media clip" j&om the 
media clip dajtabase. Moreover, Cox is lunited to disclosing a simple user interface that displays 
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a set Of four linages. wHrK w>uld be fcnhflnced with the addition of richer controls to mAic^c 
whether an image resembles the tarsftVs color or shape. The enhanced user interfece of Cox still 
fails to teach or suggest '^presenting urfeiiD?»tinn associated with said selected media clip," 
because provi<iling a button to indicate that an image icsonblfts the target's color does not provide 
any descripti^: information associated with an image. Only applicants' invention fl5 reciiea m 
Claim I prnviHcs for ^'presenting information associated wtfa said selected media clip". 

Additifmally, applicants rcApectMy submit that Cox fails to teach or suggest "in 
response to thp user selecting a search criteria based on inftnrmation associated with the selected 

clip, retrieving all media clips in said media clip database that have associated information that 

I 

inatchcs the Sheeted search criteria for the selected media clip." Cox fails to allmv the user to 

I 

select a scarcli criteria hascd On infomiotion associated with the selected clip. Rather, the user of 

i 

the Cox inveijtion is limited to sMmVi. criteria based on a computed probability distribution, Cos: 

also fails to allow the user to retrieve "all media clipg in said media clip database that have 

associated information that matches the selected search criteria for the selected media clip." 
I 

Rather, Cox ik limited to retrieving images with the highest computed probability ranking, which 
is not the sariifJ retrieving images '*that have associated iitformation that matches the selected 
search criteri^". Only applicants' inventinn as recited in Claim 1 provides ''in response to the 
user selecting a search criteria based on information associated with the selected clip, retrieving 
all media cl^s in a media clip database that have associated informatinn that matches the 
selected scarcih criteria for the selected media clip/' 

applicants jcspcctfiiUy submit that Cox feils to teach any of the subject matter 
recited in Cl^ 1 . Thus, applicants rcspcctfidly siihmit that Claim 1 is allowable and request the 
withdrawal oifthe § 1020?) rejection. 



I 
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Claims' 2-9 and 14 din^^rtly or indirectly depend from Claim 1. Therefore, thft analysis 
discassed aboye with respect to CWm \ algp applies Claims 2-9 and 14. Thus, applicanf* 
respectfully silbmil that Claims 2-9 and 14 arp. ;iUowable for at least the same reasons as Claim I. 
Additionally, Claims 2-9 and 14 recite further subject m^^ttcr that is not taught or suggested by 

Cox. Applicants respectfully submit that Claims 2-9 and 14 arc allowable for this reason in 

I 

adxijtinn tn thrisc discussed above with respect to Claim 1 . 

i 

Claim rccitrs a computer-readable medium havinR computer-executable instructions 
for performing the meihod recited in any one of Claims 1-14. Therefore, the analysis discussed 
above with respect to Claims 1-14 also applies to Claim 15, Thus, applicants respectfully submit 
that Claim 15 'is allowable for the same reasons as Claims 1-14. 

Applicants have amended Claim 16 similar to Claim I. In ifs present form Claim 16 

! 

recites a method for providijig "a u$er interface for a visual thesaurus for a media dip database 

I 

associated with a multimedia application program, wherein said media clip database contains 
information that describes each associated media clip in said media clip database." The method 
of Claim 1 6 rLites "in response to the user selecting a media dip from said media dip database, 
displaying to jthe user an option for finding aimilar me<Ka cUps that have associated information 

that matdifis bie assnriated infoimation for the selected clip." As discussed above with respect 

j 

to Claim 1, Cox fails to teach or siiggRst searching a media clip database that includes 

i 

information ^eociated with each media clip m the medifi clip da^basc and wherein aaid 
infotnnalion describes the associated media clip. Cox also fails to teach or siigge<st pmviding the 
user with aT5| option for finding similar media dips "that have associated infoimation that 
matches the associated information for the, selected clip.'* Rather, Cox is limited to disdosing 
searching fori and finding images based on a compntcd proliahiUty distribution that the image is 
the target of ,a search. It is not the same to search for clips, or images based on a probability 
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distribution, opposed to whether or not the clip has associated information that matches 

.c^oivx. vwl^:^ V^^J^fS^ith appliQimtr I.rT,rrtfi.in.ir ^thmit thflt PHX fRTlq TO tfi a Ch QT 



suggest the method of Claim 16. Thtis, applicants respcctfiilly suhrmt that Claim 1^ is allowable. 

Clauni 17-20 direotly or indirectly depend from Claim 16. Therefore, the analysis 
disrus^iKd abcivc with rcspfcct to Claim 16 also applies to Claims 17-20. Thus, appHcanta 
lespectfiilly sijbmit tfe^t Claims 17-20 arc allowable for at least the same reasotis discussed above 
with re^l to Claim 16. Additionalty, Claims 17-20 recite further subiect matter not taught or 

suggested by Cox and are allowable for this addjtioiml reason as well. 

1 

Claimj23 recites a computer-readable medium havmg compiter-cxecutablc instructions 
fcwr pftrformijife tihc method recited in any one of Clahns 16-22. Therefore, applicants iRspcctfuDy 
submit that tlie analysis discussed above with respect to Claims 16-22 also applies to Claim 23. 

Thus, applicakts respectfully submit that Claim 23 is allowable for the same reasons as Clauns 

I 

16-22. j 

Applicants have amended Claim 24 similar to Claim 1, In it's pittsent form. Claim 24 

! 

Tecitcs an ap^iaratus that parallels the method of Claim 1. Therefore, ^plicants icspectftiHy 
submit that tlje analyr^is riiscnrvsed above with respect to Claim 1 also applies to Claim 24. Thus, 
applicants re^ctfuUy submit that CJaim 74 is allowable far the same reasons as Claim L 

Clain^ 25-32 dkectly Or indirectly depend from Claiin 24. Therefore, the analysis 
discus3ed abpve with respect to Clahn24 also appUes to Claims 25^37. Thus, applicants 
lespectfolly -iihmit thiofc Claims 25-32 are allowable for the same reasons as Clakn 24. 

Clainis 36-37 depend from Claim 24, Therefore, the analysis discussed above with 
respect to c|aiin24 also applies to Claims 36-37. Thus, applicants | respectfully submit that 

Claims 36-37 allowable for the same reasons discussed above with respect to Claim 24. 

i 
i 
i 
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Claim 38 recites an arr«'*atus parallels the method of Claim 16. Therrcforc. tjie 
analysis discuised above with respect to Ckim 16 also afpplies to Claim 38. Thus, applicants 
lespcctfiilly aiibmit that Claim 38 is allowable fbr the same reasons as aaim 16. 

Claims 39-42 directly or Indirectly depend imm Claim 38. Therefore, the analysis 

! 

di.scu5scd abotvc %vith respect to Claim 38 also ^plies to Claims 39-42. Ihua. appiicanxs 

respectfiiliy .'^ijhmit that Claims 39-42 are allowable fbr at least the same reasons discu350d above 
with respect td Claim 38. 

^eje^nn o f Claims 21-22. 43- and 44 UndfT y S H. 6 1 

The Oiffice Action rejected Claims 21-22 and 43-44 under 35U.S.C. § 103(a) as being 
tn>p?itentahlc Ler Cox. With respect to dependent aaim21, the Office Action acknowledges 
that Cox failJ to fr^oh image previewing. However, the Office Action stales that Cox suggests 
previewing irnages because Cox teaches a search mterface of multiple clip images, with earh 
unage viewed and judged by a user untU the user presses "found" to indicate that the target image 
has been fouid. The Office Action states ihat it would have hccri obvious to one of ordinary 
skill in the art at the time of the invention, in view of Cox, to provide image previewing, which 

provides the advantage of allowing a user to visualize groups of candidate images at ocace for 

I 

more precise selection. 

Claim 21 depends from Claim 16. Thexeforc. the analysis discussed above with respect 
to Claim 16 also apphes to Claim 21. Thus, applicants respectfully submit that Claim 21 is 
allowable fat at least the same reasons as Claim 16. Additionally, CWm 21 recites further 
subject mattirx not taxigKt or suggested by Cox- Applicants agree with the Offtce Action ja that 
Cox feils to teach or suggest previewing an image. More specifically. Claim 21 further recites 
displaying tq the user an option for previewing the selected clip. Only applicants' claimed 
invention provides a pxeview function that causes a more comprchMv^ivc viewing of the clip. If 
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the cUp is a pibture clip, an actusd-sirc vcrgion of the picture is shoMH on the display. KXhc clip 

is an audio clip, the audio ifi played. If the clip b a video clip, the video clip is shown on the 

display. If tli cUp jg a text clip, the text is show on the display. In contrast to the present 

invcnticm, Co^ is liiruted to teaching and suggesting a user faiterfecc that is ijitcntioiifllly kept as 

I . 
simple pnMible and is designed to display four linages on the screen for presentation to a user. 

All that Cgx rlisrlnpcs is that the user can select one or more of the displayed images using the 

mouse. Simjily because Cox disdnscs viewing four images on the screen does not teach or 

suggest previewinR the selected clip to enable a more comprehensive viewing of the clip. Cox 

I 

fails to suggest any function that the user may invoke to cause a more rnmpmhensivc view of the 
clip or imag^. Therefore, applicants respectfully submit that Claim 21 is allowrihle for this 
reason in addition to those discussed above with respect to Claim 16, 

With tcspect to dependent Cbiit* 2.2, the Office Action acknowledges that Cox fails to 
teach an option to add a clip to a category. However, the OfFtr^ Action asserts that Cox suggests 
independent ([ategorization of clip images by a user because Cox teaches th?»t a \i.ser can indicate 
whE^hRT m ijiagc resembles a target's color, texture, etc The Office Action states that it woaW 
have been obvious to one of ordinary skill in the art at the time of the invention, in view of Cox, 
to add a clip jto a category becausp it would provide the user with more freedom of control for 
more customized oateRorizations. 

Qaini 22 depends from Claim 16. Therefore, the analysis discnj^scd nhove with respect 
to aaim 16 |also RppKcs to Claim 22. Thus, applicants respectfully .submit that Claim 22 is 
aUowablc for at least the same x^iasons as Claim 16. , Additionally, 'Clahn 22 recites further 
subject matter not taught or suggested by Cox. More spccijpioally. Claim 22 further recites 
"displaying tf> the user an option to add the clip to one or more categories." Applicants agree 
with the Offikc Action in that Cox fails to teach or sugfiest displaymg to the user an option to add 
j 

i 
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lie clip to one or more caiegoiies. Applicsnts also agree with the Office Action b that 
displaying to pie user an option to add the clip to one en jnore categoriea is an advantafteous 
fcfitiirc of appkcants' inventioiu However, it is oidy applicants' cbiincd invention that teaches 
and suggBste *is advantageous feature. Only appUcanls' invention enables the ii.v.t to invoke on 
"add category!' fiinrtim that causes an "add category" user interfece to be displayed. The "add 
category" usej interface provides a mcchairism for the user to add the selected clips to any of the 
existing categjjiies, including a "favorites" ratpgmy. Only applicants' invention aUows ihe user 
to search for isimilar cUps and add selected clips to an existing category. In conliHst, Cox is 
liinitftH tn teaching and suggesting a simple user interface that can be enhancprt sn that the user 
can indicate fwhcttcr an image TXJflCtnbles a target's color, shape, texture, or compositian. 
Indicating whether an image resembles « target's color, shape, texture^ or composition fails lO 
teach or suggbst adding an image to a category. Thus, Cox suggests tbat the uaer may indicate 
Tether an iihage resembles a target's shape, textore, or coroposition for purposes of searohine 
for sijnilar iniages but foils to teach or suggest that the user may add the image to a category. 
Searching fox an imagf: is not the same as adding an image to a category. Only applicants' 
invention as ijecited in Claim 22 allows the user to search for similar images and organize hnages 
by adding the image '*to one or more categories." Therefore, applicants rcspcctfiilly submit that 

ClaiTn22 is allowable for this reason in addition to those discussed above with respect to 

I 

Claim 16. I 

The 6ffice Action rejected d«pendcnt Claims 43 and 44 along the same rationale as the 
rejection of Claims 21-22, Claims 43 and 44 recite an apparatus that parallels the methods of 

r 

Claims 21 axil 22. Therefore, the analysis discussed above with respect to Claims 21 and 22 also 
applies to Claims 43 and 44. Thus. appUcants respectfully submit that Claims 43 and 44 are 
allowable foi! the same reasons a? Claims 21 and 22. 
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p^^t; ^n niflimK 10-12 and 33-:^5 Undp r '^f^ TI S.C. S \03(s): 

The okce Action rejected Claims 10-12 ?ind 33-35 under 35 U.S.C. § 103(a) as being 

unpatentable over Cox in further view of Jain. With respect to dependent Claims lO-H, the 

Office Actior^ acknowledges that Cox fails to teach or suggest keywords as a aeaich criteria. 
I 

However, thij Office ActioD asserts that Jain teaches content-based sc?ach and retrieval 
comprising image analysis, along with a query window comprising a set of keywords, such as a 
single keywoid (i.e., ''trekking"), and a kflywnrd indicating a file name (i.e.. himasky.gif). The 
OfBoe Action| states tiiat h would have been obvious to one of ordinary skill in the ait at the time 

the invention; was made to apply the keyword query of Jain to the search criteria of Cox, 

I 

allowmg sivsex nf Cnx greater latitude in choosing search criteria. 

I 

Claimb 10-12 dirccdy or in/lircctly depend from Claim L Thereforej liie analysis 
discussed above with respect to Claim 1 also flppUca to Claims 10-12. Thus, applicants 
respectfully submit that Claims 10-12 are allowable fbr at least the same reasons discussed above 
with ittspect jto Claim I. Additionally, Claims 10-12 recite further subject matter that is not 
taught or suggestexl hy Cox or Jain, cither alone or in combination. For example. Claim 11 
fiirther recite^ ibat "the keyword is selrntcd frrnn a list of keywords." Only applicants' invejntioa 
provides the laser with a presentation of a list of kf?ywnTds associated with the selected clip and 
that are retriWed from the media dip database. This unique fBatiirc of ^licants' invention 
address^.? the pTOblem tiiat occurs when a ufiet is not be skilled in formulating complex queries 
and needs assistance in selecting keywords for searching for images. Additionally, this unique 
feanire of apfpUcants' invention is hclpflil even jfnr skilled users that do not know what search 
terras to apflly because graphics and sounds are dif&cult to describe in words. As a result, 

i 

i^ppHcants prrmde a suitable search tool diat is able to accommodate a user who docs not know 

exacdy whatj he or sbe is looking for, but will "know it \^rtien I see it." Applicants' invftntinn 

j 

i 
I 
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enables the user to advantageously scktst search criteria from a Ust af keyv/ords that are 
wsociated witk the selected clip. In tWs way. the user who does not know which leniis to use to 
aeaich foi a similar clip is provided with thr a.<isnc)ated terms or keywords that can be used to 
find similar clips- 

Jn coritrast to the present invention as recited in Claims 10-12, Jain is limited to 
disclosing a clmvcntional query, which does not solve the jHoblems of users who irrf. not skilled 

I 

at formulating compiot qnf-ries or even skilled users who do not know what search tcnns to 
^ly becaus^ graphics and sounds are? difficult to describe in words. Again, Jain is limited to 
disclosing a (Jueiy window including a dialog box. fnr keywords that the user can enter in to 

j 

fonnnlfftc a (juery for aearching for images. Jain is generally fnoiscd on providing a visual 
infoiiTjaticin retiievaji cn^^c for retrieving images based on visual queries. A visivil feature ia 
any property |of an image iliat c?in be computed uaine computer vision and image processing 
techniques si^h as hue, saturation, and intensity hisrfngranis. Jain also, discloses that the visual 
information retrieval system also supports standard textual attributes as do all standard databases. 
Thus. Jain is limited to disclosing conventional or etandaxd textual database queries. Jain fails to 
teach or suggpst prRscnting the user with search criteria that includes "a list of keywords" that are 
associated with the selected clip so n-s to enable the u5cr to select search criteria for finding 
similar clipsj that have associated information that matches the selected search criteria. 
Tlierefore, applicants respectfully submit that neither Cox nnr Jatn, cither alone or in 
cconbinatirm i teaches or suggests the additional subject matter recited by depKndqnt Qaims 
10-12. Thusj applicants respectfully submit lhflt Claims 10-12 axe aUowable for these reasons in 
addition to fl|ose discussed above with respcci to Claim I . , 

The bffice Action rejects dependent Claims 33-35 wi* tHo same rationale as the 
Txgcction of (fclaims 10-12. Claims 33-35 recite an apparatus that panilfels the methods recited in 
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Claims 10-12.1 Therefore, thr. analy^ns digcoased Bbovc with respect to Claims 10-12 ^Iso applies 
to Claims 33-35- Thus, applicants respctrtfuDy subinit that Claims 33-35 are allowable for the 

same reasons as Claims 10-12, 

I CONCLUSION 
In vicjv of the foregoing, applicants respectiuUy submit th;it fJ.1 of tbc claims in the 
preseni appUrjatinn are in condition for aUowance. Reconsideration and reexammation of the 
application are requesfp,H; allowance of ihc rqected claims and passage of the appUcation to issue 
at an early date are solicited. If thp Examiner has any questions or comments concerning this 
application, the Examiner is invited to contact the applicants' undersigned attorney at the number 
set forth below. 



Respectfully submitted. 

CHRWTFKSEN O'CONNOR 
JOHNSON KINDNESS^c 

Barbara M Lcvri 
Registration No. 45,483 
Direct Dial No. 206.6?5.1T76 

I hereby cerdfy thai this rorrcTKwidcnce b being tnmamrtted via faoeimile-to: United Statfifi Patent and 
Tnulianark Of5|cc. Group Art Unit 2176. Examiner William L, Baihore, at ftcsinille numter 703.746.7239, on 
AprU15,2002 j 
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VP.RSTON WITH MARKINGS TQ RTIOW CHANGES MADE APRIL 15, 200?. 



In the Title: 



The title has been amended as follows: 



VISUAL THESAURUS AS APPLIED TQ MEDIA CL IP SFARCHING 

In the Claims :' 

I 

The Cjaims have been EanenHrd fl5 follows: 

1, I (Amended) A method for searching a [plmUty oflmedia clip[s] database 
flssodated wit h a oiulti media application program, wherein said m aHm clip Hflt^Viflfie cmitaina 
infrmTurtirrn tlUt describes each aasQciat ed media clip in said med ia cUp database, comprising^] : 

m res^ioivsc tn a iricr selecting a media Glip^Tetrievijig^^infbrmatioii associated with said 



selected medi 



I clip from said media clip dataha<ie: 



pfflsftritin ^ said information associated with said selected media clip: and 



se to the u ser selecting a search criteria based on sairi infnrm^ tinn associated 
with satc^ .sclrictcd media clip, retrieving all meSa clips in [a] said media dip database that h^vs 

associated information that [tnatcK] matches the sel^fed search criteria fox the selected media 

i 

clip. I 
I 

13. i (Amended) The method of Claim 1 , wherein the search criteria Ml^ides [is all of 

the] a list of lceywords that are associated with the selected media clip. 

I 

! 

16. [ (Amended) A method for providing a user interface for a visual thesaurus for a 
caedi a clip ditabase associated with a multimedia applicat inn pmpran^; wherein said media clip 
d atabase co^»ina mfnrm ation that describes each associat ed media clip in said me^ia clip 
dfrtaba^r . cnjtiprisingU: 
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in icsponae to a user selecting a media clip Wi said mediBudiE-datal^ase, displaying to 
the user m niTtioti for finding 5imila r_media oUpS [similar to] that have asggggtod inf ormaiion 

thatmatch£5 the assndated information for the selected clip. 

I 
I 

18. ! (Amended) The method of Claim 16, further crnnprising, in response to a user 
selective the joption for finding similar cUps, displaying means for the user to select search 
criteria for firiding .similar cHps^b^g jn said .searc h.criteria is based on inform^rtion AggPOiftted 

with s aid selected clip . 

i 
I 

24. I (AmcndfiH) An epparatus for searching a plurality of media cUps, comprising: 
I (a) a processing xmit^ arid 

I (b) a Storage medium couplftH to the processing unit, the storage meditim 

storing program code implemented by the processing unit for: 

i 

' (i) providing an interfeoe for a user to select a media cUp from_fl 

media clip database associy ^-r^ ^^th a tnnltimedia app licatio ii program, wheret o s a id media clip 
datahafi a cQrjtaing mformation that dflson hrs raeh associated media: clip In fiaid media clip 
jfttabase: j 

I (ii) providing an interface for the user tn select Ja] search criteria baaed 

on infbrmatimn assnci&tftd with said selected media cHe; and 

; (iii) in resrwsc to the user selecting the niedia clip and the search 

criteria, retrieving all media cUps in [a] the media clip database that h^associal ed information 
^hat [match] tofljch^ the selected search criteria for the sciccttH media clip. 



36* ! (Amended) The apparatus of Claim 24, wherein the search criteria informgtion 
includes [is all of the] a List of keywoids that are associated with thr selected media clip. 
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38. 



i (Amended) An apparatus for providing a user interfece &r a visual thesaurus Jjr 
a media clip dktabTisi^ assnrJated with a mnltimedia ap pUcatio D proffram, w her ei n thg nicdi;i. r.lip 

database co ntking iTifo mmtion that descrihc3 eac h associated media clip in said media clip 

i 

database, comjpnsing: 

; (a) a processing unit; and 

i (b) a storage medium coupled to the processing unit, the storage medium 
frtnnng prtjgrtin code implemented by the processing unit for displaying to a user an option for 
fmding gimilaT TnaHia clips [similar to] that have a saoeial ed informati on that matches the 
associated infbimation for a selected media clip, in response to the user selecting the media clip, 

40. (Amended) The apparato of Claim 38. wherein the program code displays 
means for a ufeer to select search criteria basr/i <m mf ntmation aaaociated with said selected clip 
for finding siihilar clips, to response to the user selecting the option for finding similar clips. 

In the Abstract : 

The title has been axnended as follows: 

visuKl thesaurus as applied tq media cl ip searching 
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